ON RECURRENCE OF REFLECTED 
RANDOM WALK ON THE HALF-LINE 



MARC PEIGNE AND WOLFGANG WOESS 
WITH AN APPENDIX ON RESULTS OF MARTIN BENDA 

Abstract. Let (Y n ) be a sequence of i.i.d. real valued random variables. Reflected 
random walk (X n ) is denned recursively by X = x > 0, X n+1 = \X n — Y n+ i\. In this 
note, we study recurrence of this process, extending a previous criterion. This is obtained 
by determining an invariant measure of the embedded process of reflections. 



1. Introduction 

Reflected random walk was described and studied by Feller [10]; apparently, it was 
first considered by von Schelling [IE] in the context of telephone networks. 

Let (Y n ) n > be a sequence of i.i.d. real valued random variables, and let S n = . .+Y n 
be the classical associated random walk. Reflected random walk is obtained by considering 
a non- negative initial random variable Xo independent of the Y n and considering Xo — S n , 
n — 0,1, as long as this is non-negative. When it becomes negative, we change sign 
and continue from the new (reflected) point by subtracting Y n+ i, Y n+2 , until the next 
reflection, and so on. Thus, we consider the Markov chain X n given by X„ +1 = |X„— 
We are interested in recurrence of this process on its essential (i.e., maximal irreducible) 
classes. 

We start by considering the situation when Y n > (of course excluding the trivial case 
Y n = 0), so that the increments of (X n ) are non-positive except possibly at the moments 
of reflection. In this case, Feller [10] and Knight [13] have computed an invariant 
measure for the process when the Y n are non-lattice random variables, while Boudiba [5], 
[6] has provided such a measure when the Y n are lattice variables. Leguesdron [H], 
Boudiba [6] and Benda [2] have also studied its uniqueness (up to constant factors). 
When that invariant measure has finite total mass - which holds if and only if E(Yi) < oo 
- the process is (topologically) recurrent: with probability 1, it returns infinitely often to 
each open set that is charged by the invariant measure. 

Our main result is that reflected random walk is still recurrent when Y n > and 
J °° Pr[Yi > t} 2 dt < oo ; see §3 for the case when the Y n are lattice random variables, and 
§4 for the non-lattice case. The result is based on considering the process of reflections, 
that is, reflected random walk observed at the instances of reflection, see §2. We determine 
an invariant measure for the latter. The above "quadratic tail" condition holds if and 

1 /2 

only if that measure is finite. This holds, in particular, when E(Y 1 ) < oo. 
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Subsequently, in §5, we also consider the case when the Y n may assume negative as well 
as positive values. Reflected random walk is of interest when lim sup n S n = oo almost 
surely. Let Y\ = — Y{~ be the decomposition into positive and negative part. If 
E(Y L ~) < E(Y 1 + ) then the situation is similar to the case when Y\ > a.s., and we get 
recurrence when E(^Y 1 + ) < oo . If the Y n are centered, that is, < E(Y 1 _ ) = E(F 1 + ), 

then we get recurrence under the moment condition E^a/Y^ ^ < oo , which turns out to 
be almost sharp. 

Our methods are based on interesting and useful work of M. Benda in his PhD thesis [2J 
(in German) and the two subsequent preprints [3], [I] which have remained unpublished. 
For this reason, we outline those results in the Appendix (§6). 

2. The process of reflections 

In this and the next two sections, we suppose always that (Y n ) is a sequence of i.i.d, 
non-constant, non- negative random variables. Let /i be the (common) distribution of 
Y n , a non-degenerate probability measure on [0 , oo) , and F(x) = F^x) = fi([0 , x}) the 
associated distribution function (x > 0). Denote by /i^ its n-th convolution power, the 
distribution of S n , with (jf® = <5 . Since S n — > oo almost surely, the potential 

oo 

(2.1) W = J> (n) 

n=0 

defines a Radon measure on [0 , oo) , that is, U(B) < oo if B is a bounded Borel set. 

Now consider the sequence of stopping times (r(/c)) fc > , where r(0) = 0, and r{k) {k > 0) 
is the time of the fc-th reflection: 

r(k + 1) = inf {n > r(k) : X n = -{X n _ t - Y n )} 

= inf{n > r(k) : (Y r[k)+1 + ... + Y n ^ + Y n ) > X r(k) } . 

Once more because S n —>■ oo, each r(k) is finite almost surely. We call the embedded 
process R k = X T ^) the process of reflections. 

(2.3) Lemma. The process of reflections is a Markov chain with transition probabilities 
given as follows: if B C [0 , oo) is a Borel set, then 



q{0,B)=n(B) and q(x,B)= / fi(B + x - w) U{dw) , if x > . 

J[0,x) 

Proof. It is clear that (R k ) is a (time-homogeneous) Markov chain. We compute 

oo 

q{x, B) = Pr[i?i eB\R = x} = Y^ Pr[r(l) =n, S n - x G B] 

n=l 

oo oo „ 

= Pr i S n-l <X, S n ~X E B}=J2 / Pr i Y n + W-XEB] ^ n ~ l \d W ) 

fi(B + x — w)U (dw) , 

[0,x) 

as proposed. □ 
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It is an instructive exercise, relying on the fact that supp(yu) C [0 , oo), to show directly 
that q(-, •) is stochastic. 

Now the idea is the following: if the embedded process of reflections is recurrent, then 
also the original reflected Markov chain must be recurrent. 

3. The lattice case 

We start with the discrete case, which is instructive and has to be treated separately 
anyway. Here we suppose that there is k > such that supp(/i) C K ■ No, and we may 
assume without loss of generality that k — 1. (By N we denote the non- negative integers.) 

The one-step transition probabilities of (X n ) are 

(fi(x) , if y = , 

H(x + y), iix<y, 
fi(x — y) + fi(x + y) , if x > y > . 

We write p^^x, y) = Pr[X n = y \ X = x] for the n-step transition probabilities. Set 

d = gcdsupp(/i) and N = sup supp(/i) . 

If the reflected Markov chain starts in a deterministic point X = xq £ [0 , oo), then (X n ) 
evolves within the state space 

SOo) = {kd ± x : k £ Z} n [0 , oo) . 

Recall that an essential class of a denumberable Markov chain is a subset C of the state 
space which is irreducible and absorbing: if x £ C then p^ n \x,y) > for some n if and 
only if y £ C. The next lemma follows from [6] when the starting point xq is rational, 
and when it is irrational, it is immediately seen to be true as well. 

(3.2) Lemma. The reflected random walk (X n ) starting at xq is absorbed after finitely 
many steps by the essential class C(xq) = S(xq) D [0 , N] . 

When we speak of recurrence of (X n ) with starting point x then we mean recurrence 
on C(xo). This is known to be independent of xq [6]. 

If iV = oo then C(xn) = S(xo). Also, if supp(/x) is finite then C{xq) is finite and carries a 
unique invariant probability measure. An invariant measure v (not necessarily with finite 
total mass) exists always. Its formula is due to [5], where only x £ Z is considered, but 
it can be adapted to the present situation with arbitrary starting point as follows. Set 

(3.3) i/(0) = 1 ~g and u(x) = + n((x , oo)) , if x > . 

Here, we mean of course //(x) = fi({x}), so that /i(x) = when x £ [0 , oo) \ No . Then 
the invariant measure v Xo on C{xq) is given by the restriction of v to that essential class: 
if B C C(x ) then u XQ (B) = X^gb u ( x ) ■ 

(3.4) Corollary. The reflected random walk starting at xq is positive recurrent on C(xq) 
if and only if the first moment n fi(n) of Yk is finite. 
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If the reflected random walk is (positive or null) recurrent on C(a:o), then it follows 
of course from the basic theory of denumerable Markov chains that v xo is the unique 
invariant measure (up to multiplication with constants). 

We now consider the process of reflections. 

(3.5) Lemma. The set C(x ) is also the unique essential class for (R k ) starting at x . 

Proof. Since C(x ) is the only essential class for (X n ), we only need to verify that it is an 
irreducible class for (Rk). We have to show that for x, y G C(x ), it occurs with positive 
probability that (X n ), starting at x, reaches y at some reflection time r(k). 

There is m G supp p such that m > y. Then also m — y G C(xq), and there is n such 
that p( n \x,m — y) > 0. But from m — y, the reflected random walk can reach y (the 
reflection of —y) in a single step with positive probability p{m), and this occurs at a 
reflection time. □ 

Our simple new contribution is the following. 

(3.6) Theorem. Set p(0) = 1 - ^ and 

fa) = E Or* + ^f^) m , if x > o . 

Then the restriction p XQ of p to C(xo) is an invariant measure for the process of reflections 
(Rk) on C(xq). It is unique (up to multiplication by a constant), if u xo is the unique 
invariant measure (up to multiplication by a constant) for the reflected random walk (X n ) 
on C(xo). 

Proof. We first show that p Xo is invariant. The index xq will be ommitted whenever this 
does not obscure the arguments. Also, note that by its definition, p = on S(rr ) \ C(x ), 
so that we can think of p XQ as a measure on the whole of S(xq) with no mass outside 
C(x ) . 

Consider the signed measure A defined by A(x) = S (x) — p(x) for x > 0. Then we 
have the convolution formula A*U = U * A — 5 , that is 

n 

(3.7) Y,AU)U(n-j)=6 (n). 

3=0 

Now we verify that for each real x G (0 , N] , 

oo 

(3.8) p(x) = ^A(k)u(x + k). 
Indeed, the last sum is equal to 

oo oo 

(1 - p(0))is(x) - E>(*0 <x + k) = J2^) (v(x) - u(x + k)) , 

k=l k=l 
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which is equal to p(x). We remark here that the sum in (13.81) is absolutely convergent, 
since u(-) < 1. Combining (13. 8p with the inversion formula (13.71) . we get 

OO OO CO 

S ^U(k) p[x + k) =J2U(k) ^A{l)v{x + k + l) 

k=0 k=0 1=0 

oo n 

n=0 k=0 

oo 

= ^2is(x + n)5 {n) , 

n=0 

that is, 

oo 

(3.9) u(x) = ^2l({k)p{x + k) , x>0. 



k=0 

If a is any measure on C(xq) then we write 

e ct (-)= 

where E w (-) denotes expectation when the starting point is X = w. We claim that 

A(i)-i \ 

(3.10) u(x) = E Pxo I J2 M-Xi) I . if % e C(x ) . 

Indeed, if x — then the right hand side of (13.101) is p(0) = ^(0), since the reflected 
random walk can reach the state before the first reflection only when it starts at 0, in 
which case r(l) = 1. If x > 0, x G C(a;o) then the reflected walk starting from w G C(xq) 
can reach x before the first reflection only if w = x + k for some k G No such that k = Sj 
for some j > 0. We compute 

'r(l)-l \ / oo n-l 

:,. + , I E,., ^•l,,(r(l))^l,(.V / 

j=0 J \n=l j=0 

oo 

= Y Pr l X j = r (!) > j \ X = x + k] 

3=0 
oo 

= Pr[x — x + k — Sj] — U(k) . 

j=0 



Therefore 



'r(l)-l 

E Pxq [ ^ Ixft) I =J2p(x + k)U(k) = u(x), ifx>0 

j=0 I k=0 
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as proposed. From (13.101) . we infer that 

A(i) 

Now v satisfies u(w)p(w,x) = u(x), and applying (13.101) once more, we obtain 

E Pxo {l x (X ))=E Pxo {l x (X r )). 

The left hand side is p(x), while the right hand side is J2 W p{ w )o.{ w i x )> where q(-, •) is the 
transition kernel of the process of reflections. Thus, p xo is invariant for (Rk) on the state 
space C(x ). 

We now prove uniqueness. In view of Lemma 13.51 this is of course obvious by the basic 
theory of denumerable Markov chains, when p Xo (C(xo)) < oo, but this is not supposed in 
our statement. 

So let p be another invariant measure for (Rk) on C(xo) , again considered on S(xo) with 
zero mass outside C(xq) . Using the formula of Lemma \2. 31 for the transition probabilities 
of (R k ), we get for y G C(x ) 

oo 

p(y)= Yl U(k)^(w + y-k) = Y Y U(k) p(w) n(w + y - k) 

weC(xo) keN :0<k<w k=0 w&C{x Q ):w>k 

To have a non-zero contribution in the last double sum, w + y has to be integer, d must 
divide both k and w + y, and x = w — k G C(xq) . Therefore we can rewrite 

oo 

p(y) = Y U(k)p(x + k)n(x + y) . 

k=0 x€C(x ):x>0 

Now let x G C(xq) , x > 0. Again, there is m G supp(/x) with x < m, and y = m — x G 
C(xo) • Therefore 

fw(fc) p(x + k) < 44 < oo 
^ y ' K ' ~ u(m) 
k=o ^ K ' 

for each x G C(xo) with x > 0. This allows us to define a new measure v on C(x ) by 

p(0) = p(0), if G C(a? ), and 



Y u ( k ) P( x + k), if x > 



oo 

]'(.)■) 

k=0 

and a straightforward exercise shows that it is legitimate to apply the inversion formula 
(13. 7p to deduce that 



p(x) = Y] -Aft) v(x + k) , if x > , 

fc=0 

The same computations as that lead to (13. 9p and (I3.10p show that 
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is an invariant measure for (X n ) on C(xn). By uniqueness of the latter, v = c ■ v xo for 
some c > 0. Therefore p = c ■ p xo . □ 

(3.11) Corollary. The total mass of p Xo is finite for some (equivalently, every) starting 
point xq if and only if 

oo 

(3.12) ]T(l-i^)) 2 <oo. 

k=0 

Proof. We write H(x) = 1 — F^{x). For real a > 0, let E(a) = Y^h=aP{ a + ^d). Let a 
be the unique number in (0 , d] such that x — a is an integer multiple of d. If an = d 
or an = d/2 we have p(C(xn)) = p(0)5n (C(xn)) + E(an) , while otherwise p(C(xn)) = 
E(a ) + E(d — a ). Thus, we prove that for any a G (0 , d], we have E(a) < oo if and 
only if (13.121) holds. Recalling that p(x) = if x is not a multiple of d, we compute 
S(a) = S (a) + Ei(a), where 



oo oo 



x x -v u(a + kd) — u(a + kd + md) 
s o(«) = 2^1^ 9 ^ md ! 



k=0 m=l 



is always finite, and 

£i (a) = ^ ^ ( H (a + kd) - H(a + kd + md) \ p(md) 



oo oo 



k=0 m=l 
oo m—1 



\J if (a + fed) /i(md) 

m=l k=0 

oo oo oo 

^if(a + fcd) ^ p(md) = ^ H (a + kd) H (kd) . 



k=0 m=k+l k=0 

Since H(-) is decreasing, on one hand 



oo _ oo 

T ll (a)<Y,H{kdf = -^-F,{k))' 



d 

k=0 k=0 



and on the other hand 

oo 1 oo 

Ex(a) >Y,H{(k + l)d) 2 = - 5^(1 - F,(fc)) 2 - H(0f . 

k=0 k=0 

Thus, Ei (a) and the sum in f 1 3 . X 2 j) are finite, resp. infinite, simultaneously. □ 
The following is now immediate. 

(3.13) Theorem. Suppose that the "quadratic tail" condition (I3.12p holds. Then the 
process of reflections (Rk) is positive recurrent on C(xq) for each starting point xq > 0. 
If in addition E(Y"i) = J2k>o^ M^) < °°> then the reflected random walk (X n ) is also 
positive recurrent on C XQ , while it is null recurrent when E(Y"i) = oo. 

Finally, it is easy to relate the "quadratic tail" condition with a moment condition. 

(3.14) Lemma. IfE{^fY[) = E fc >o < oo, then (I3TT2D holds. 
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Proof. We use the Cauchy-Schwarz inequality: 

oo \^/oo \ / oo \ oo 

E ^ k n ^ E E m*W* <e(v^) E m*o/v*. 

v fc=n+l / \fe=n+l / \fc=n+l / k=n+l 

Therefore, 

oo oo oo 2 

E(i-^H) 2 <E( v / n)E E Kk)/y/k=(E{y/Y 1 )) , 

n=0 n=0 fc=n+l 

which is finite. □ 

4. The non-lattice case 

We now consider the case when supp(/i) C [0, oo), but there is no k > such that 
supp(yu) C n ■ N . Again, denote N = supsuppf^), and set C = [0 , N] if iV < oo, resp. 
C = [0 , oo), if N = oo. The transition probabilities of the reflected random walk are 

p(x, B) = fj,({y :\x-y\e B}) , 

where B C [0 , oo) is a Borel set. For the following, we need to specify in more detail the 
probability space on which we are working. This is the product space (ft, Pr) = C N ?/ u N ), 
where Y n is the n-th projection. It will be convenient to write for the reflected walk 
starting at x > 0, so that Xq = x and X^ +1 = \X* — Y n +i\ as in the Introduction. We 
also write X£ n (n > k) for the reflected walk starting at time k at x, so that X^ = X { 
Note that we always have 



X 

0,n- 



I 4 - 1 ) \ X k,n+l ~ X k,n+l\ ^ \ X k,n ~ X k,n\ ■ 

The following is due to [ID], [TH] and [Hj. 

(4.2) Lemma, (a) The reflected random walk with any starting point is absorbed after 
finitely many steps by the interval C. 

(b) It is topologically irreducible on C, that is, for every x G C and open set B C C, there 
is n such that B) = Pr[X n G B \ X = x] > . 

(c) The measure v on C given by 

v(dx) = (l — Ffj,(x)) dx , 
where dx is Lebesgue measure, is an invariant measure for p(-, ■). 

From (14.11) . one deduces the following. 

(4.3) Lemma. Pr{X* -»■ oo] G {0 , 1} , 

and the value is the same for each starting point x. 

Proof. By (14. lft . the event [X% —>■ oo] is in the tail cr-algebra of the (V^). □ 

If Pr[X^ — ► oo] = 1, then we call the reflected random walk transient. 
We now state two important results that were proved in [T3] in the case when E(Yi) < 
oo, and in the general case in [2]. 
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(4.4) Proposition. In the non-lattice case, reflected random walk is locally contractive: 
for every bounded interval I C C and all x, y G C ; 

lim li(X*) \X* — X*\ =0 almost surely. 

If Pr[X^ — > oo] = 0, then one even has 

lim \X% — X%\ = almost surely. 

Of course, also reflected random walk started at time k is locally contractive for each 
k > 0. The proof of Proposition 14.41 is outlined in the Appendix. 

For uj G Q, let L x (u) be the set of (finite) accumulation points of the sequence X*(u). 
In the transient case, L x (-) is almost surely empty. Otherwise, contractivity implies that 
there is a set L C C, the attractor of the process, such that 

(4.5) Pr[L x (-) = L for all x G C] = 1 . 

Thus, for any x G C, every open set that interesects L is visited infinitely often by (X%) 
with probability 1. In other words, the attractor L is topologically recurrent, so that it is 
justified to call the random walk recurrent when Pr[X^ — > oo] = 0. 

Proposition 14.41 has the following important consequence, see the Appendix. 

(4.6) Proposition. In the recurrent case, L = C , and the measure v defined in Lemma 
\4-S\ c is the unique invariant Radon measure for p(- , ■) up to multiplication with constants. 

Thus, we have topological recurrence on the whole of C . Now, v is invariant even in 
the transient case. If E(Yi) < oo then v(C) < oo , and we have recurrence by [T4J. As 
in the lattice case, we want to extend this recurrence criterion. Here is the continuous 
analogue of Theorem 13.61 regarding the process of reflections of $21 with a rather similar 
proof. 

(4.7) Theorem. In the non-lattice case, the measure p on C, given by 

p(dx) = I / , x + y]) ^(dy) J dx 

\J[0,oo) J 

is an invariant measure for the process of reflections (Ru). It is unique (up to multipli- 
cation with constants) , if the measure v is the unique invariant measure for the reflected 
random walk (up to multiplication with constants). 

Proof. We use once more the convolution identity A*U = U * A = 5 , where A = 5 — \i. 
For any Radon measure M. on R, we denote by M. its reflection: Ai(B) = A4(—B) for 
Borel sets BcM. We write again H(x) = 1 — F^(x) for the density of v with respect to 
Lebesgue measure, and h(x) for the density of p. Then 

h(x)= i (H(x) - H(x + y)) n(dy) = H(x) - fi* H(x) = A* H(x) , 

J[0,oo) 
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that is, p = A * v. Therefore with the same computations as above, 



v 



r(l)-l 

(B)=U* p(B) = E p I 1« 



3=0 



where of course we intend E p = J E w (-) p(dw). Now invariance of v for the reflected 
random walk implies invariance of p for the process of reflections precisely as in the proof 
of Theorem 13.61 

For proving uniqueness, let p be an invariant (Radon) measure for (-R&). Once we can 
prove that the convolution v = U * p, restricted to [0, oo), defines a Radon measure 
(i.e., is finite on compact sets), we can proceed as before: v is invariant for (X n ), whence 
v = c ■ v for some c > 0, and p = A* v = c ■ A* v = c ■ p. 

If iV < oo then p has finite mass, since it must be concentrated on [0 , N] by Lemma 
14.21 Let IAn be the restriction of 1A to [0 , N] . It is also a finite measure, and on [0 , N] , 
we have U * p = Un * p, which is again finite. 

Now suppose that iV = oo. Let a > 0. Then supp(/i) contains an element M > a. 
Choose b such that a < b < M. Now let / be a compactly supported, continuous function 
on R, supported within [0 , oo), such that / = 1 on [M — b, M + b}. Then the convolution 



p * f(x) 



f(v — x) p(dv) 



[0,oo) 



defines a continuous function. 

Exe[0,a] then f(v-x) = 1 for all v G [M-b + x, M + b + x] D [M-b + a, M + b). 
Therefore 

fi*f(x) > fi([M-b + a, M + b]) > for each x e [0 , a] . 



Using this, the invariance of p for (Rf.), the formula of Lemma T2.31 and Fubini's theorem, 
we now compute the finite number 



f{x) p{dx) 



[0,oo) 



[0,oo 
f 

[0,oo 
f 

[0,oo 
f 

[0,oo 
f 

[0,oo 

r 

[0,oo 



f(y) l(x,dy) p(dx) 



[0,oo) 



[0,oo) J[0,x) 



f(y + w — x) U(dw) p(dy) p(dx) 



f(y + w — x) p(dx) U (dw) p(dy) 

[0 , oo) J [w , oo) 

f(y-x) [5^ w * p\(dx) U(dw) p(dy) 

[0,oo) J[0,oo) 

p * f(x) [5_ w * p](dx) U(dw) 



[0,oo) 

p*f(x) [U * p](dx) 



> p([M -b + a, M + b]) U* p([0 , a]) 
Therefore U * p([0 , a] J is finite for each a > 0. 



□ 
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The following is now obtained precisely as in the lattice case. 



(4.8) Corollary. The invariant measure p of the process of reflections has finite mass if 
and only if 



(4.9) 



/ (l - F^x)) 2 dx < oo 

J[0,oo) 



This holds, in particular, when E(yTi) = Jj ^ \fx fi(dx) < oo . 

We now want to deduce recurrence of reflected random walk. This is not as straight- 
forward as in the case of Markov chains with a denumerable state space. 



(4.10) Proposition. Let J 

J(e) = (a + s , b — e), 



(a, b) C C be a bounded, open interval. Then, setting 



Pr 



3 £ >0 : X>j (£) pq 



oo 



n=0 



€{0,1} 



Proof. Each of the countably many events 

lim l[ , m ]pf£J \X% >n - X 



y I 

fc,n I 







where x, y G C are rational and k, m G No, has probability 1. Let Q$ be their intersection, 
so that Pr(f2 ) = 1. Consider the event 



A x j = n |J B* J{£) , 

0<£<(b-a)/2 



where B x J(e) 



X> (£) ra = oo 



,n=0 



We claim that Aj does not depend on x. Let y G C. If u; G A j then there is e G (0 , ^=2) 
such that uj G -S/( e )- There are rational numbers x,y G C such that |x — x| < e/4 and 
\y — y\ < e/4. Since u; G f2 , we have 

|X»-Jf*(«)|<e/4 

for all sufficiently large n. Since \X* — X*\ < \x — x\ and \X* — X%\ < \y — y\, we get 
that X% (u) G J(e/4) whenever X*(u) G J(e). Therefore, Aj C Aj, and exchanging the 
role of x and y, we see that Aj = Aj is the same for all x. 

Now, we claim that Aj is in the tail cx-algebra of the (Y n ) n >i. Let uj G Aj and a; G Q 
such that for some fceN, 5 / n (^) = ^n(^) for n > k. Then clearly a; G Qq. Set it = Yfc(u;) 
and v = Y k {u). Then we have X%(u) = X^ n {u) and X%(Q) = X v k>n {u) for all n > k. Now 
the same "e/4" -argument as above implies that u; G Aj. 

Therefore Pr(Aj) G {0 , 1} by the 0-1 law of Kolmogorov. □ 

(4.11) Theorem. Suppose that the "quadratic tail" condition (14. 9 j) holds. Then, for 
every starting point x > 0, the reflected random walk (X%) is topologically recurrent: for 
every bounded, open interval J G C, 



Pr 



^l J (X:) = oo 



n=0 
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If in addition E(Yi) = Jj Q s x p(dx) < oo, then (X x ) is positive recurrent, while it is null 
recurrent when E(Y"i) = oo. 

Proof. We write (R^) for the process of reflections starting at x £ C, and define 



Ml 



1 n— 1 

-J2Ud R D and M- = limsupM:, 



k=0 



where e > is chosen such that J(e) is non-empty. The measure p of Theorem 14.71 is 
supported by the whole of C, and p(C) < oo by assumption. We have 



[0,oo) 



I M x n dPx p(dx) = p(J{e)) 
Jq 



Since p(C) < oo by assumption and < M n < 1, we may apply the "lim sup" -variant of 
the Lemma of Fatou to obtain 

M x dPr p(dx) > p(J(e)) . 
3p(J(e)) 



'[o,oo) Jn 

Therefore there must be x £ C such that 



M x dPr > 



4p(C) 



Consequently, 

< Pr[M x > c] < Pr 



£l J(<0 (X») = oo 



ra=0 



where c 



2p(Q 



> 0. 



Proposition 14.101 now yields that 



Pr 



3e>0 : jS J(e) (X«) = oa 



n=0 



and the result follows. 



□ 



Note that we should be careful in stating that the process of reflections itself is topo- 
logically recurrent on C when it has a finite invariant Radon measure. Indeed, it is by no 
means clear that it inherits local contractivity, or even the property to be Fellerian, from 
reflected random walk. 

5. General reflected random walk 

In this section, we drop the restriction that the random variables Y n are non-negative. 
Thus, the "ordinary" random walk S n = Y\ + • • • + Y n may visit the positive as well as 
the negative half-axis. Again, p will denote the distribution of each of the Y n . In the 
lattice case, we suppose without loss of generality that supp(/i) C Z, and that the group 
generated by supp(p) is the whole of Z. In the non-lattice case, the closed group generated 
by supp(p) is BL 

We start with a simple observation ([1] has a more complicated proof). 

(5.1) Lemma. If p is symmetric, then reflected random walk is (topologically) recurrent 
if and only if the random walk S n is recurrent. 
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Proof. If fi is symmetric, then also \S n \ is a Markov chain. Indeed, for a Borel set B C 
[0,oo), 

Pr[ \S n+ i\ E B \ S n = x] = /i(-x + B) + n(-x - B) - (jl(-x) 6 (B) 

= Pr[\S n+1 \eB\S n = -x], 

and we see that \S n \ has the same transition probabilities as the reflected random walk 
governed by \i. □ 

Recall the classical result that when E(|Yi|) < oo and E(Yi) = then S n is recurrent; 
see Chung and Fuchs [9J. So if \x is symmetric and has finite first moment then reflected 
random walk is recurrent. 

In general, we should exclude that S n — ► — oo, since in that case there are only finitely 
many reflections, and reflected random walk tends to +00 almost surely. 

Let = max{F n , 0} and Y~ = max{— Y n , 0}, so that Y n = Y+ — Y~. The following 
is well-known. 

(5.2) Lemma. // (a) E(Ff ) < E(F+) < 00 , or if (b) < E(Yf ) = E(F+) < 00 , then 
limsupSVi = 00 almost surely, so that there are infinitely many reflections. 

We note that Proposition 14.41 is also valid here, since its proof (see the Appendix) 
does not require non-negativity of Y n . Also, when the Y n may assume both positive 
and negative values with positive probability, then the essential class, resp. classes, on 
which reflected random walk evolves is/are unbounded. In the non-lattice case this is 
C = [0 , 00), and X® is locally contractive. 

In the sequel, we assume that lim sup S n = 00 almost surely. Then the (non-strictly) 
ascending ladder epochs 

£(0) = , £(k + 1) = inf{n > £(k) : S n > S m } 

are all almost surely finite, and the random variables £(k + 1) — £(k) are i.i.d. We can 
consider the embedded random walk Si(k) , k > 0, which tends to 00 almost surely. Its 
increments Yk = S^(jt) — S^k-i) > k > 1, are i.i.d. non-negative random variables with 
distribution denoted Ji. Furthermore, if X\ denotes the reflected random walk associated 
with the sequence (Yk), while X* is our original reflected random walk associated with 
(Y n ), then 

A k — ^£(k) ) 

since no reflection can occur between times £(k) and £(k + 1). 

(5.3) Lemma. [2] The embedded reflected random walkX^ is recurrent if and only the 
original reflected random walk is recurrent. 

Proof. Since both processes are locally contractive, each of the two processes is transient 
if and only if it tends to +00 almost surely: in the lattice case this is clear, and in the 
non-lattice case it follows from local contractivity. If lim n A^ = 00 then clearly also 
lim.kX%, k j = 00 a.s. Conversely, suppose that lim k X k — ► 00 a.s. If £(k) < n < £(k + 1) 
then X* > X^, k y (Here, k is random, depending on n and ui G £1, and when n — >• 00 then 
k — ► 00 a.s.) Therefore, also lim n X^ = 00 a.s. □ 
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As long as lim sup S n = oo , we can consider the reflection times as in ( 12.2ft for the case 
of non-negative Y n . The observation that there is no reflection between times £(k) and 
£{k + 1) yields the following. 

(5.4) Lemma. The reflection times for (X%) and (X x k ) are the same, so that reflected 
random walk and embedded reflected random walk have the same process of reflections. In 
particular, if the latter has a finite invariant measure, resp., if it is non-transient, then 
(X%) is (topologically) recurrent on its essential class(es). 

We can now deduce the following. 

(5.5) Theorem. Reflected random walk (X%) is (topologically) recurrent on its essential 
class (es), if 

(a) E(Y{~) < E(F+) and E(^/Y+) < oo , or if 

(b) < E(Yf ) = E(Y+) and e(JY+ 3 \ < oo . 

Proof. We show that in each case the assumptions imply that E(a/ YA < oo. Then we 
can apply Lemma |3.14[ resp. Corollary 14.81 to deduce recurrence of (X&). This in turn 
yields recurrence of (X*) by Lemma 15.41 

(a) Under the first set of assumptions, 




< E(V^+ • • • + yfifa) = ■ E(£(l)) 

by Wald's identity. Thus, we now are left with proving E(£(l)) < oo . If E(Y 1 + ) < oo, 
then E(|Yi|) < oo and E(Yx) > by assumption, and in this case it is well known that 
E(£(l)) < oo; see e.g. [TQ1 Thm. 2 in §XII.2, p. 396-397]. If E(r+) = oo then 
there is M > such that Yn M ^ = min{ Y n , M} (which has finite first moment) satisfies 
E(F n (M) ) = E(y/ M) ) > 0. The first increasing ladder epoch £^ M \l) associated with 
£^ A/ ) = Y^ + . . . + Yn^ has finite expectation by what we just said, and £(1) < £ ( - M - ) (1). 
Thus, £(1) is integrable. 

(b) If the Y n are centered, non-zero and E((F 1 + ) 1+a ) < oo , where a > 0, then E((Yi) a ) < 
oo , as was shown by Chow and Lai [8]. In our case, a = 1/2. □ 

In conclusion, we discuss sharpness of the sufficient recurrence conditions E^y^T 3 ^) < 

00 in the centered case, resp E(v / ^T) < oo in the case when Y± > 0. 

(5.6) Example. Define a symmetric probability measure /i on Z by 

/i(0) = , fj,(k) = fi(-k) = c/k 1+a (k + 0) , 

where a > and c is the proper normalizing constant. Then it is known that the associated 
symmetric random walk S n on Z is recurrent if and only if a > 1, see Spitzer [T7J p. 
87]. By Lemma 15.11 the associated reflected random walk is also recurrent, but when 

1 < a < 3/2 then condition (b) of Theorem 15.51 does not hold. 
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Nevertheless, we can also show that in general, the sufficient condition E^a/ Y\ j < oo 

for recurrence of reflected random walk with non-negative increments Y n is very close to 
being sharp. (We write Y n because we shall represent this as an embedded random walk 
in the next example.) 

(5.7) Proposition. Let /x be a probability measure on No such that Ho(n) > /i (n + 1) 
for all n > and 

/Xo(n) ~ c (log n) b / n 3//2 , as n — > oo , 
where h > 1/2 and c > 0. Then the associated reflected random walk on No is transient. 

Note that /xq has finite moment of order | — e for every e > 0, while the moment of 
order | is infinite. 

The proof needs some preparation. Let (Y n ) be i.i.d. random variables with values in 
Z that have finite first moment and are non-constant and centered, and let /x be their 
common distribution. The first strictly ascending and strictly descending ladder epochs 
of the random walk S n — Y\ + . . . + Y n are 

t+(l) = mi{n > : S n > 0} and t_(l) = inf{n > : S n < 0} , 

respectively. They are almost surely finite. Let /x+ be the distribution of St+(i) and /x_ 
the distribution of St_(i), and - as above - /7 the distribution of Y\ = S^iy We denote the 
characteristic function associated with any probability measure a on M by a(t) , t e M. 
Then, following Feller [TO], (3.11) in §XII.3], Wiener-Hopf-factorization tells us that 

jj, = JI + fi_—JI*jj,_ and /Z = m • 5q + (1 — u) ■ /x + , 
1 ' ; where u = /l(0) = PrlS 1 ! < , . . . , 5 n _ a < , S n = 0] < 1 . 

71=1 

(Recall that * is convolution.) 

(5.9) Lemma. Let be a probability measure on No such that Ho(n) > fio{ n + 1) f or oil 
n > 0. T/ien there is a symmetric probability measure fi onZ such that that the associated 
first (non- strictly) ascending ladder random variable has distribution fiQ. 

Proof. We decompose /i = A*o(0) • <$o + (l — A*o(0)) • yU x , where /i x is supported by N 
(i.e., /i x (0) = 0). If /i is the law of the first strictly ascending ladder random variable 
associated with some symmetric measure fi, then by (15.81) we must have /i_ = fi x , the 
reflection of /i x at 0, and 

(5.10) /I = fjL + /i x - Mo * Ax = M0) -S + (l- M0)) • (^x + Ax - A*x * fix) ■ 

We define \i in this way. The monotonicity assumption on /xq implies that /x is a probability 
measure: indeed, it is straightforward to show that /x(/c) > for each fceZ. 

The measure /x of (15.101) is non-degenerate and symmetric. If it induces a recurrent 
random walk (S n ), then the ascending and descending ladder epochs are a.s. finite. If 
(S n ) is transient, then |,S n | — > oo almost surely, but it cannot be Pr[S n — > oo] > since in 
that case this probaility had to be 1 Kolmogorov's 0-1-law, while symmetry would yield 
Pr[S n — ► — oo] = Pr[S n — > oo] < 1/2. Therefore liminf Sn = — oo and limsupS n = +oo 
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almost surely, a well-known fact, see e.g. pm Thm. 1 in §XII.2, p. 395]. Consequently, the 
ascending and descending ladder epochs are again a.s. finite. Therefore the probability 
measures fi + and = jx + (the laws of St ± (i)) are well defined. By the uniqueness 
theorem of Wiener-Hopf-factorization [10, Thm. 1 in §XII.3, p. 401], it follows that 
jj,- = fx x and that the distribution of the first (non-strictly) ascending ladder random 
variable is fx = (xq. □ 



Proof of Proposition \5. 7[ Let fx be the symmetric measure associated with fx according 
to (15.101) in Lemma 15.91 Then its characteristic function fi(t), given by (15.81) . is non- 
negative real. A well-known criterion says that the random walk S n associated with fx is 
transient if and only if (the real part of) l/(l — //(£)) is integrable in a neighbourhood of 
0. Returning to fx, it is a standard exercise (see (101 Ex. 12 in Ch. XVII, Section 12]) to 
show that there is A G C , A ^ such that its characteristic function satisfies 

Ji(t) = 1 + AVi (hg t) b (l + o(t)) ast^O. 

By (El, 

1 _ m = (i _ u ) (i _ fr + (t)) (1 - ffl(t)) . 

We deduce 

fi(t) = 1+ (l-/x (0)) \A\ 2 1 (\ogt) 2b (l + o(t)) ast^O. 

The function l/(l — At(t)) is integrable near 0. By Lemma 15.11 the associated reflected 
random walk is transient. But then also the embedded reflected random walk associated 
with Se( n ) is transient by Lemma I5T31 This is the reflected random walk governed by fx. □ 

6. Appendix: local contractivity 

Here, we come back to propositions 14.41 and 14.61 They arise as special cases of two main 
results in the PhD thesis of Benda [2] and of the contents of the two papers [3] and [I] , 
which were accepted for publication but remained unpublished. For this reason, we give 
an outline, resp. published references for their proofs. In [3], this is placed in the following 
more general context. Let (X, d) be a proper metric space (i.e., closed balls are compact), 
and let (3 be the monoid of all continuous mappings X — > X. It carries the topology of 
uniform convergence on compact sets. Now let fx be a regular probability measure on 
<5, and let (F n ) n >i be a sequence of i.i.d. (5-valued random variables (functions) with 
common distribution fx. The measure fx gives rise to the stochastic iterated function 
system (SFS) X* defined by 

(6.1) Xq = x G X , and X x n = F^X^) , n > 1 . 

In the setting of the above Sections EHll we have X = [0 , oo) with the standard distance, 
and F n (x) = \x — Y n \, so that the measure fx is the image of the distribution fx of the Y n 
in $2] under the mapping [0 , oo) — > (3 , y t— > g y , where g y (x) = \x — y\. 

(6.2) Definition. The SFS is called locally contractive, if for all x G X and every compact 
K C X, 

1k(X*) ■ sup d(X*, X%) — > almost surely, as n — » oo . 

y&K 
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This notion was first introduced by Babillot, Bougerol and Elie pQ and was later 
exploited systematically by Benda, who (in personal comunication) also gives credit to 
unpublished work of his late PhD advisor Kellerer, compare with the posthumous 
publication [12J. 

Using Kolomogorov's 0-1 law (and properness of X), one gets a general variant of 
Lemma 14.31 

(6.3) Lemma. For a locally contractive SFS of contractions, 

either Pr[d(X*,x) — > oo] = for all x £ X, 
or Pr[d(X*,x) — > oo] = 1 for all x £ X. 

Proof. Let B(r) , r £ N be the open balls in X with radius r and fixed center o 6 X. It 
has compact closure by properness of X. Consider 

(6.4) X^ n = F n o F n _! o . . . o F m+1 (x) 

for n > m, so that X® = X^ n . Then local contractivity implies that for each x £ X, we 
have Pr(fio) — 1 for the event Qq consisting of all ui £ Q with 

(6.5) lim l B{r) (X x n {uj)) ■ sup d(X*Ju),X*Ju)) = for each r £ N , m £ N . 

n ^°° yeB(r) ' 

Clearly, Q is invariant with respect to the shift of the sequence (F n ). 

Now let to £ VLq be such that the sequence (X%(uj)) accumulates at some w £ X. 
Fix m and set v = X^(uj). Then also (X^ n (o;)) > accumulates at w. Now let y £ X 
be arbitrary. Then there is r such that v,w,y £ -B(r). Therefore also [X^ (u)) > 
accumulates at w. In particular, the fact that (X^(o;)) >Q accumulates at some point 
does not depend on the initial trajectory, i.e., on the specific realization of F±, . . . ,F m . 
We infer that the set 

[ui £ Qo : (X^(cj)) n>0 accumulates in X} 

is a tail event of (F n ) n >i. On its complement in Oq, we have c?(X^,x) — > oo . □ 

If d(X®, x) — > oo almost surely, then we call the SFS transient. What has been said 
about the attractor in H4.5[) for reflected random walk is true in general. For wGfi, let 
L x '(co>) be the set of accumulation points of (X^(a;)) in X. A straightforward extension of 
the argument used in the last proof (using again properness of X) yields the following. 

(6.6) Lemma. For any non-transient, locally contractive SFS, there is a set L C X the 
attractor - such that 

Pr[L x {-) = L for all x £ C] = 1 , 
Thus, (X%) is (topologically) recurrent on L when Pr[d(X%,x) — > oo] = 0. 

(6.7) Proposition. For a recurrent locally contractive SFS, there is a unique invariant 
Radon measure v on X up to multiplication with constants, and supp(^) = L. 

This is contained in |'2j and [3j. The proof of the existence of such a measure supported 
by L is rather straightforward, compare with the old survey by Foguel [11] . (One first 
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constructs an excessive measure supported by L via a ratio limit argument, an then uses 
recurrence to obtain that it has to be invariant.) For a proof of uniqueness that is available 
in print, see BROFFERIO [H Thm. 3], who considers only SFS of affine mappings, but the 
argument carries over to general locally contractive SFS without changes. 

Let us now consider a more specific class of SFS: within (3, we consider the closed 
submonoid £ of all contractions of X, i.e., mappings / : X — > X with Lipschitz constant 
L(f) < 1. We suppose that the probability measure Jl that governs the SFS is supported 
by £, that is, each random function F n of (16.11) satisfies L(F n ) < 1. In this case, one 
does not need local contractivity in order to obtain Lemma 16.31 this follows directly from 
properness of X and the inequality 

d(x-,xy)<d(x, y ). 

Let &(Jm) be the closed sub-semigroup of £ generated by supp(/I). The following key 
result of [2] is inspired by p31 Thm. 2.2], where reflected random walk with E(Y n ) < oo 
is studied. 

(6.8) Proposition. If (i) the SFS of contractions is non-transient, and (ii) the semigroup 
C £ contains a constant function, then 

D n (x, y) = d(X®, X%) — > almost surely, as n — > oo . 

Proof. Since D n +i(x, y) < D n (x,y), the limit D^ix^y) = lim n D n (x,y) exists and is 
between and d(x,y). We set w(x,y) = E(D oc (x, y)) . First of all, we claim that 

(6.9) lim w(X^,X^) = D^x.y) almost surely. 

To see this, consider X^ n as in (16.41) . Then D mi00 (x,y) = liir^ d(X^ n , X^ n ) has the 
same distribution as D^x^y), whence E(D m>OQ (x,y)) = w(x,y). Therefore, we also have 

E(D m , 00 (XZ l ,Xyj\F 1 ,...,F m )=w(Xl,Xl). 

On the other hand, D mt00 (X^ ,X^) = D^Xjy), and the bounded martingale 

(E(D 00 {x,y)\F 1 ,...,F m )) 

\ v / m>l 

converges almost surely to Doo(x,y). The proposed statement (16.91) follows. 

Now let e > be arbitrary, and fix x,y G X. We have to show that the event 
A = [Dooix, y) > e] has probability 0. 
(i) By non-transience, 

Pr (U fl U K> ^6B(r)] =1. 

\reN meN n>m / 

On A, we have D n (x,y) > e for all n. Therefore we need to show that Pr(A r ) = for 
each r G N, where 

A r =f] (J [X% , X v n G B(r) , D n (x, y)>e\. 

m£N n>m 
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(ii) By the second hypothesis, there is xq G X which can be approximated uniformly 
on compact sets by functions of the form f k o ... o / 1; where fj G supp(/x). Therefore, given 
r there is k G N such that 



Pr(C fcjr ) > , where C, 



k,r 



sup d(X% , x ) < e/4 

ueB(r) 



On Ck, r we have D^iu^) < Dk(u,v) < e/2 for all u, v G B(r). Therefore, setting 
5 = Pr(Cfc ir ) ■ (e/2), we have for all u,v G B(r) with d(u,v) > £ that 

w(u,v) = E(l Cfe;r Doo(M,f)) + E(l X \a fc , r -DooK^)) 

< Pr(C fc>r ) • (e/2) + (1 - Pr(C fc , r )) • d(u, v) < d(u, v) - 5 . 

We conclude that on A r , there is a (random) sequence (n^) such that 

w(Xl,Xyj<D ne (x,y)-5. 

Passing to the limit on both sides, we see that (16.91) is violated on A r , since 5 > 0. 
Therefore Pr(A r ) = for each r. □ 

(6.10) Corollary. If the semigroup &(JT) C £ contains a constant function, then the SFS 
is locally contractive. 

Proof. In the transient case, X* can visit any compact K only finitely often, whence 
Ik(X^) —>■ a.s. In the non-transient case, we use the fact that by properness, X has 
a dense, countable subset Y. Proposition 16.81 implies that with probability 1, we have 
\im n D n (x, w) = for all w G Y. If K C X is compact and e > then there is a finite 
W C Y such that d(y, W) < e for every y G K. Therefore 

sup D n (x, y) < ma.xD n (x, w) +e , 
yeK »£W 

— > a.s. 

since D n (x, y) < D n (x, w) + D n (w, y) < D n (x, w) + d(w, y). □ 



Proof of Proposition 4-4' Reflected random walk is an SFS of contractions, since L(g. 



1 for the function g y (x) = \x — y\. [14, Prop. 2] shows that the constant function 
x I— > is contained in the semigroup &(JT), where \i is the law of the increments Y n 
and Jl its image in the semigroup £ of contractions of X = [0 , oo) under the mapping 
V l— *■ 9yi 9yi x ) = \ x ~ y\- Note that this statement and its proof in jT3] are completely 
deterministic, regarding topological properties of the set supp(/x) C [0, oo) , and do not 
rely on any moment condition. □ 

Proof of Proposition \4-6] If reflected random walk is recurrent, then we know from Propo- 
sition 16.71 that there is a unique invariant Radon measure up to multiplication with con- 
stants, and its support is the attractor L. On the other hand, we already have the invariant 
measure v given in Lemma I4.2[ c. and its support is C. □ 
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